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The  University  of  Massachusetts  participated  with  Purdue  University  and  the  University  of 
California  at  Irvine  (under  separate  contractual  efforts)  in  a  teamed  research  effort  to  advance  the 
state-of-the-art  in  software  testing.  The  University  of  Massachusetts  has  collaborated  with  its 
research  partners  on  developing  improved  data  flow  analysis  capabilities  and  on  the  development 
of  integrated  testing  strategies  that  synergistic  ally  combine  static  and  dynamic  approaches.  This 
effort  is  part  of  the  DARPA  Evolutionary  Design  of  Complex  Software  (EDCS)  Program. 

The  EDCS  project  made  important  progress  along  numerous  fronts.  Research  activity  was 
centered  on  work  on: 

•  Finite  state  verification 

•  Software  process  technology 

•  Self  adaptive  software 

•  Distributed  object  technology 

In  addition,  there  was  considerable  activity  aimed  at  dissemination,  publication,  and  student 
training. 

We  first  briefly  summarize  the  research  accomplishments,  and  then  list  the  many  dissemination 
activities  wherein  can  be  found  details  of  our  accomplishments. 


RESEARCH  ACTIVITIES: 


Finite  state  verification: 

On  this  project  we  made  important  progress  in  our  work  with  finite  state  verification.  Although 
we  continued  our  work  on  applying  our  Flow  Analysis  for  Verification  of  Systems  (FLA VERS) 
data  flow  analysis  system  to  Ada  software,  towards  the  end  of  the  project,  our  emphasis  and 
focus  shifted  to  applying  FLA  VERS  to  Java  software. 

FLA  VERS  is  a  flexible,  powerful  system  for  automatically  guaranteeing  the  absence  or  detecting 
the  presence  of  a  wide  range  of  user-specified  properties  or  behaviors  in  both  sequential  and 
concurrent  systems.  FLA  VERS  complements  traditional  testing  approaches,  which  only 
demonstrate  the  presence  or  absence  of  errors  for  the  specific  test  cases  that  have  been  executed. 
It  also  complements  formal  verification  methods,  which  employ  more  comprehensive  analysis, 
but  require  extensive  expertise  on  the  part  of  the  user.  FLA  VERS  is  built  using  the  FLA  VERS 
toolkit,  a  flexible  architecture  and  component  library  that  facilitates  the  development  of 
FLA  VERS  analyzers.  The  toolkit  allows  FLA  VERS  to  be  extended  with  additional  specialized 
data  flow  analyzers  and  to  be  applied  to  a  wide  range  of  languages  and  systems.  FLA  VERS  has 
been  applied  to  the  analysis  of  Ada  and  C++  and  Java  is  underway.  It  has  also  been  used  for  the 
analysis  of  network  protocols  and  architecture  specifications. 

Work  on  the  Ada  version  of  FLA  VERS  had  been  aimed  at  continuing  to  speed  the  system  up  and 
improve  the  system’s  handling  of  more  features  of  the  language.  A  great  deal  of  emphasis  was 
also  placed  throughout  the  project  upon  usability.  There  was  considerable  effort  devoted  to 
developing  a  graphical  user  interface.  It  resulted  in  the  development  of  a  user  interface  that 
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makes  FLA  VERS  far  more  accessible  to  wider  classes  of  non-expert  users.  This  work  was 
intended  to  facilitate  the  transition  of  this  technology  to  foster  adoption  and  the  consequent 
ability  to  evaluate  this  technology  more  effectively  and  thoroughly. 

During  the  latter  stages  of  the  project  we  also  developed  a  process-driven  user  interface  to 
FLA  VERS.  This  work  used  the  Little- JIL  process  programming  language  and  the  Juliette 
interpreter  to  create  a  system  capable  of  guiding  users  through  the  use  of  FLAVERS  by 
orchestrating  the  appearance  of  appropriate  windows  from  the  graphical  user  interface,  and  the 
graying  out  of  buttons  to  prevent  users  from  attempting  to  use  FLAVERS  in  inappropriate  ways. 
This  work  can  be  seen  as  a  continuation  of  long-standing  research  in  how  to  make  integrated 
toolsets  and  environments  more  effective  and  better  integrated.  Thus,  this  EDCS  project  has 
made  an  important  contribution  to  this  area  of  research  which  is  increasingly  being  understood 
and  appreciated  by  the  practitioner  community  in  view  of  its  growing  interest  in  integrated 
programming  environments. 

In  the  final  stages  of  this  project,  a  great  deal  of  effort  was  devoted  to  continuing  the 
development  of  a  Java  version  of  FLAVERS.  This  work  had  been  initiated  earlier  in  the  project, 
but  continued  on  through  prototype  system  development  during  the  final  year.  Much  activity 
involved  learning  about  and  interfacing  to  Java  language  front  end  services  provided  by  our 
colleagues  at  Kansas  State  University  and  McGill  University.  In  addition,  we  continued  to 
develop  our  Java  concurrency  models,  and  created  prototype  implementations  of  analysis 
capabilities  for  Java.  We  also  worked  to  converge  the  internal  architectures  of  our  Ada  and  Java 
analyzers,  moving  us  strongly  in  the  direction  of  being  able  to  analyze  systems  of  mixed  Ada  and 
Java  code. 


Software  Process  Technology: 

Little- JIL  is  a  graphical  language  developed  by  the  University  of  Massachusetts  for  defining 
processes  that  coordinate  the  activities  of  autonomous  agents  and  their  use  of  resources  during 
the  perfonnance  of  a  task.  Little- JIL  programs  are  executable  so  that  agents  can  be  guided 
through  a  process  while  ensuring  that  their  actions  adhere  to  the  process.  Little- JIL  programs  are 
also  statically  analyzable  to  ensure  that  reliability  requirements  are  satisfied  for  all  executions  of 
the  process. 

Flexible  and  adaptive,  a  Little- JIL  process  program  defines  a  variety  of  ways  of  accomplishing 
tasks  that  can  work  with  varying  resource  requirements  and  varying  agent  capabilities.  Agents 
may  be  human  or  automated  (software  or  robots,  for  example).  The  choice  of  particular 
techniques  for  a  particular  context  can  be  made  automatically  based  on  resource  availability  or 
left  up  to  intelligent  agents.  Thus,  Little- JIL  process  programs  need  not  tightly  control  the 
behavior  of  agents,  but  rather  guide  them  through  the  maze  of  alternatives  and  facilitate  their 
communication  and  resource  sharing. 

Semantically  rich,  the  Little- JIL  language  provides  features  that  allow  proactive  control  flow  as 
well  as  the  ability  to  react  to  error  situations  and  external  events.  Pre-  and  post-requisites  are 
used  to  dynamically  verily  that  the  process  is  being  applied  correctly.  Resources  are  defined 
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using  a  rich  resource  model  and  are  reserved  and  locked  during  the  execution  of  a  process.  An 
agenda  manager  provides  communication  with  the  agents  using  a  graphical  user  interface  for 
human  agents  and  an  API  for  automated  agents. 


Language  Features 

•  Task-centered  semantics  that  support  multi-agent  coordination  High-level  proactive 
control  constructs  allow  scheduling  and  drive  execution  forward 

•  Reactions  support  event-driven  processes 

•  Powerful  exception  handling  for  recovery  from  failures 

•  Pre  and  post-requisites  help  to  detect  and  manage  process  deviations 

•  Resource  modelling  and  management  guides  and  constrains  execution 

•  Information  flow  represents  communication  between  tasks 

•  Visual  notation  facilitates  understandibility  and  conciseness 

On  this  project  we  spent  considerable  effort  on  improving  the  Little- JIL  language  and  the  Juliette 
interpreter  for  Little- JIL.  These  activities  were  strongly  motivated  by  considerable 
experimentation  with  the  application  of  the  language  to  diverse  types  of  process  areas.  We  wrote 
Little- JIL  process  programs  in  such  areas  as  electronic  commerce,  data  mining,  robotics,  and 
intelligent  vehicles.  Our  electronic  commerce  processes  centered  on  processes  for  supervising 
auctions.  It  is  particularly  noteworthy  that  this  work  entailed  collaboration  with  the  finite  state 
verification  work,  in  that  the  FLA  VERS  data  flow  analysis  system  was  used  to  analyze  auction 
processes  written  in  Little- JIL.  This  was  an  important  demonstration  of  the  way  in  which 
process  programs  can  be  analyzed  for  adherence  to  key  process  properties. 

As  a  result  of  these  experimental  applications  of  Little- JIL  we  made  some  significant 
improvements  to  the  language.  We  clarified  our  notion  of  “resource  bounded  iteration”,  an 
idiom  that  had  been  in  common  use  since  the  language  was  first  conceptualized,  adding  small  but 
important  improvements  to  the  specification  of  child  steps,  and  clarifying  the  semantics  of  our 
exception  management. 

Our  research  on  this  project  also  emphasized  investigation  of  the  problem  of  specifying 
resources.  We  developed  an  initial  prototype  resource  specification  and  management  system. 

Our  early  experiences  with  it  indicated  several  shortcomings  of  this  system.  As  a  consequence 
we  designed  and  implemented  an  improved  version  of  this  system.  This  early  research  suggests 
that  resource  specification  and  management  is  a  difficult  problem,  with  great  importance  to 
process  definition  and  execution,  but  it  is  a  problem  that  has  not  received  adequate  attention  from 
the  research  community. 

On  this  project  we  also  completed  the  implementation  of  an  early  version  of  the  Juliette 
interpreter.  We  demonstrated  this  system  at  the  International  Conference  on  Software 
Engineering.  This  demonstration  was  centered  on  showing  how  Little- JIL  and  Juliette  could  be 
used  to  organize  the  FLA  VERS  toolset.  This  project  was  referred  to  in  the  previous  section. 
From  the  perspective  of  the  software  process  technology  effort  this  project  should  be  viewed  as  a 
demonstration  of  how  software  process  technology  has  matured  to  the  point  where  it  can  be  used 
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to  implement  a  process-centered  environment.  This  environment  addresses  a  portion  of  the 
software  verification  phase  of  development. 


Self  Adaptive  Software: 

On  this  project  we  also  worked  on  robot  team  coordination.  Much  of  the  work  was  aimed  at 
understanding  the  notion  of  a  containment  unit.  These  software  entities  in  this  project  have  the 
important  role  of  assuming  responsibility  for  specific  forms  of  failure  resistance.  We  designed  a 
number  of  containment  units,  and  began  implementation  of  some  of  them.  These 
implementation  efforts  led  to  more  specific  understandings  of  the  nature  and  role  of  containment 
units.  This  in  turn  improved  our  understanding  of  the  nature  of  self-adaptation.  One  of  the 
significant  outcomes  of  this  project  has  been  the  identification  of  the  importance  and  difficulty  of 
self-adaptation  in  software.  It  appears  that  our  process  and  verification  technologies  can  have 
considerable  importance  in  studying  this  problem  area. 


Distributed  Object  Technology: 

Another  key  accomplishment  of  this  project  was  the  development  of  our  Grapevine  agenda 
management  system,  concluding  with  the  completion  of  a  Ph.D.  thesis  on  this  topic.  The  system 
was  developed  as  a  prototype.  Evaluation  of  this  prototype  was  by  means  of  its  application  to 
the  generation  of  an  agenda  management  system  for  the  coordination  of  the  components  of  the 
Juliette  interpreter,  and  a  system  for  coordination  of  a  laboratory  meeting  scheduling.  These 
evaluations  strongly  indicate  that  further  development  and  refinement  of  our  agenda 
management  ideas  is  indicated. 


DISSEMINATION,  PUBLICATION,  AND  STUDENT  TRAINING: 

This  section  summarizes  activities  in  these  areas. 

During  this  project  our  personnel  wrote  many  papers  and  technical  reports  listed  below.  We  are 
gratified  that  many  of  these  appeared  in  the  most  prestigious  publication  venues,  such  as  the 
International  Conference  on  Software  Engineering  and  the  Foundations  of  Software  Engineering 
Conference. 

In  addition,  project  personnel  gave  numerous  presentations  around  the  country  and  the  world.  A 
partial  listing  is  given  here. 

Finally  we  note  that  PhD  students,  Eric  McCall  and  Gleb  Naumovich  completed  their  Ph.D. 
degrees  through  support  of  this  project,  and  that  several  Masters  students  also  completed  their 
degrees. 


Publications: 
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Applying  Static  Analysis  to  Software  Architectures,  Gleb  Naumovich,  George  S. 
Avrunin,  Lori  A.  Clarke  and  Leon  J.  Osterweil,  Proceedings  of  Fifth  ACM  SIGSOFT 
Symposium  on  the  Foundations  of  Software  Engineering  (FSE  5)  and  the  Sixth 
European  Software  Engineering  Conference  (ESEC  1997),  September  1997,  Zurich, 
Switzerland,  pp.  77-93. 

The  Design  of  a  Next-Generation  Process  Language,  Stanley  M.  Sutton,  Jr.  and 
Leon  J.  Osterweil,  Proceedings  of  Fifth  ACM  SIGSOFT  Symposium  on  the  Foundations 
of  Software  Engineering  (FSE  5)  and  the  Sixth  European  Software  Engineering 
Conference  (ESEC  1997),  September  1997,  Zurich,  Switzerland,  pp.  142-158. 

An  Anytime  Approach  to  Analyzing  Software  Systems,  Dan  Rubenstein,  Leon 
Osterweil  and  Shlomo  Zilberstein,  Proceedings  of  the  10th  International  FLAIRS 
Conference  (Florida  Artificial  Intelligence  Research  Society),  May  12-14,  1997,  Daytona 
Beach,  Florida,  pp.  386-91. 

Software  Processes  Are  Software  Too,  Revisited:  An  Invited  Talk  on  the  Most 
Influential  Paper  of  ICSE  9,  Leon  J.  Osterweil,  Proceedings  of  the  19th  Nineteenth 
International  Conference  on  Software  Engineering,  May  1997,  Boston,  MA,  pp.  540- 
548. 

The  Criticality  of  Modeling  Formalisms  in  Software  Design  Method  Comparison, 

Rodion  M.  Podorozhny  and  Leon  J.  Osterweil,  Proceedings  of  the  19th  International 
Conference  on  Software  Engineering,  May  17-23  1997,  Boston,  MA,  pp.  303-313. 

Verification  of  Concurrent  Software  with  FLAVERS,  Gleb  Naumovich,  Lori  A.  Clarke, 
Leon  J.  Osterweil  and  Matthew  B.  Dwyer,  Research  Demonstration  at  the  19th 
International  Conference  on  Software  Engineering,  May  17-23,  1997,  Boston,  MA,  pp. 
594-595. 

Gaining  Confidence  in  Distributed  Systems,  Gleb  Naumovich,  Lori  A.  Clarke,  Leon  J. 
Osterweil  and  Matthew  B.,  Dwyer,  Proceedings  of  the  10th  International  Software 
Quality  Week,  Vol.  II,  Session  10,  May  27-30,  1997,  San  Francisco,  CA. 

An  Empirical  Comparison  of  Static  Concurrency  Analysis  Techniques,  A.  T. 

Chamillard,  Lori  A.  Clarke  and  George  S.  Avrunin,  Computer  Science  Department, 
University  of  Massachusetts,  Amherst,  MA,  Technical  Report  96-84,  (Revised:  May 

1997) . 

An  Adaptable  Generation  Approach  to  Agenda  Management,  Eric  K.  McCall,  Lori  A. 
Clarke  and  Leon  J.  Osterweil,  Proceedings  of  the  20th  International  Conference  on 
Software  Engineering  (ICSE  1998),  April  1998,  Kyoto,  Japan,  pp.  282-291. 

Consistency  Management  for  Complex  Applications,  Peri  Tarr  and  Lori  A.  Clarke, 
Proceedings  of  the  20th  International  Conference  on  Software  Engineering  (ICSE 

1998) ,  April  1998,  Kyoto,  Japan,  pp.  230-239. 

An  Evaluation  of  Object  Management  Systems  Architectures  for  Software 
Engineering  Applications,  Jayavel  Shanmugasundaram,  Barbara  Staudt  Lerner  and 
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Lori  A.  Clarke,  Computer  Science  Department,  University  of  Massachusetts,  Amherst, 
MA,  Technical  Report  97-47. 

The  Design  of  a  Next-Generation  Process  Language,  Stanley  M.  Sutton,  Jr.  and 
Leon  J.  Osterweil,  Proceedings  of  the  Combined  Sixth  European  Software  Engineering 
Conference  and  Fifth  ACM  SIGSOFT  Symposium  on  the  Foundations  of  Software 
Engineering,  September  1997,  Zurich,  Switzerland.  Appears  in  Springer  Verlag  Lecture 
Notes  in  Computer  Science  #1301 ,  pp.  142-158. 

Applying  Static  Analysis  to  Software  Architectures,  Gleb  Naumovich,  George  S. 
Avrunin,  Lori  A.  Clarke  and  Leon  J.  Osterweil,  Proceedings  of  the  Combined  Sixth 
European  Software  Engineering  Conference  and  Fifth  ACM  SIGSOFT  Symposium  on 
the  Foundations  of  Software  Engineering,  Zurich,  September  1997,  Switzerland. 
Appears  in  Spring  Verlag  Lecture  Notes  in  Computer  Science  #1301,  pp.  77-93. 

Experience  Using  the  JIL  Process  Programming  Language  to  Specify  Design 
Processes,  Stanley  M.  Sutton,  Jr.,  Barbara  Staudt  Lernerand  Leon  J.  Osterweil, 
Computer  Science  Department,  University  of  Massachusetts,  Amherst,  MA,  Technical 
Report  97-68. 

Programming  Parallel  Workflows  in  JIL,  S.  Sutton,  paper  presented  at  IASTED, 
March  1998,  Washington,  DC. 

Verifying  Properties  of  Distributed  Systems:  Prospects  for  Practicality,  Lori  A. 
Clarke  and  Leon  J.  Osterweil,  Proceedings  of  the  Fourth  International  Conference  on 
Achieving  Quality  in  Software:  Software  Quality  in  the  Communication  Society  (AQuiS), 
March  30-April  2  1998,  Venice,  Italy,  pp.  11-16. 

Representing  and  Reasoning  about  Knowledge  Discovery  Processes,  David 
Jensen,  Yulin  Dong,  Barbara  Staudt  Lerner,  Leon  J.  Osterweil,  Stanley  Sutton  Jr.,  and 
Alexander  E.  Wise,  submission  to  the  Fourth  International  Conference  on  Knowledge 
Discovery  and  Data  Mining,  August  27-31 ,  1998,  New  York,  NY. 

Enhancing  Design  Methods  to  Support  Real  Design  Processes,  Barbara  Staudt 
Lerner,  Stanley  Sutton,  Jr.,  Leon  J.  Osterweil,  Computer  Science  Department, 
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